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ABSTBACT / . • 

. Politics of evaluation and accojintability are no^t 
-practiced Isolely by eva^uators and accouiftants; everyone does it. 
This 'is because evaluation and accountability are fraught with 
decision situations which embody the potential to become political. 
Among sources of conflict in evaluation and accountability are 
gu<estions of" goals and priorities, economic matters, perceptions of 
evaluation and accountability by outsiders, Eva,luation is also 
thxeate^ning to many school administrators and teachers; thus external 
evaluatots have been employed by^ many groups wishing*^ to evaluate 
school programs. The implications for the school media centet f ocus 
on resources and policy-making^ with an iliforraal evaluation of the 
school library every time a budget is allocat^ed. Librarians must 
become knowledgeable in the technigiies of evaluation in order to 
provide policymakers with^edfed infprmalion, but must also learn how 
to apply these tech nig W^Tn politically sensitive environ,ments, 
(SK) ' . 
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• Unlike most other pXofession^, politics is an acrt available ' 
to anyone and practiced by eywyone. Teachers engage it, doctors 
dabble Jn it and^lawyfers seem to be perfect at it<' Some play it 
well J others' do it badly, but irkerestingTy enough, only the pro- 

* " ' ' ' '/ " ■ ' , " ' '/ 

fessionSil poTftician is said to gj^ve politics a^^bad name. Still, 
it is a very positive statement, since it implies' sometI>ing good 
about |)olities. Apparently, it's the poli^/Zcian that we must watch 
out for. Politics Jtself is a- heal thy'aq^"v4ty to participate in. 
So It' goes* • . / • . • ^ 

- We are- not surprised then to /find that the pal i tics of 

•ev^aluation and accountability , is- not practiced solely by evaluators 

.•■■/■■- * . , ■ ■ ' . * ^ .. 

and accountants. Everyone ddest/t. Y^t no^ one will say that 

evaluators/give evaluation a bafd name. S6 who does— for a bad name 

it trulj^as. ^ Couple nVt witir accountability and the* response is - 

akin to near hysteria. One ^iritid. describes accountability's *'a - 

contrived smokescreen to /confuse the public and distract attention 

from the real issues f^ing American schools.". What have evaluatton 

and accountability do^^e .to deserve -such a bad pr'ess? D6cision-making 

may have something/to do with, it. ' 




Where ! there is no choice, there *is no decision. But where ' 
there exists the possibility of ^tv/o or more aTt,ernat^'ve courses of 
action, there a decisiorj situation exists— and interestih'gly "enough 

Jbfie potential for political confrontation and the ensuing conflict 

■» ' ' " ' . • • ' 

.that usoalVy accompanies it. ; . ' 

. ' . * ■ • • -t^ ' ' ^ . ' - ■ , ' . • 

, ^ , A decision Svituation is not necessarily political ; it only/ 



embodies the potential to .become poll tical ♦ This*pbten£ial is 
-realized when the decision' situation attracts a fol Towing or a ' * ^ 
.constituency and the question of wh'o/decldes ,is raised-^'hat is', 

who chooses. ^ When this*^ constituency is of or\e thinking 'and caV)- , . 

; »- ' ■ ' ' ■'. ■ \ ■■•■/ / ■ ■ ■ ' . . . ■■ 

-easily decid^ upon *the alternative CQurse(s) of^ctibn, it has a 

membmhip wdrkihg- in harmony. -But, as Bertraml, Russell* teaches us , 

"Conventional mortality leads .us^ to expeit im^lfishaesa in decent* 

people-. This is an error." So, the reaMty of decision situations , ' 

• , * // ' * 

ft that they attract different consti Wencies pursuing their bwn 

selfish fnterests. Each camp seeks /o influence the final .determination 

of the decisrion'Snd carries pat ^p^ttisan -activities & ensure that ' 

its views- prevail . When arbitration is difficult ^and the differences 

j'n points of yiew not easily /egotiable, the politics 'of confrontation 

emerge. / y \ . 

Evaluation and accountability are fraught v/itlv decision # 

■.' ,. . / ■ • , ■ * ' ■. / ■ . ' 

situations. On the *school/scenfe these decision* sft^^iations a,ttract 
many constituencies bent on influencing the evaliiating'or the 



accounting. process in Tine with the preferences of their, fliemb^rs. 
Each caiiip seeks to. conuwnd-credit'fqr possible success but vvield ■' ' 
their power^ avoid blame for any possible failure. . The politics 
of evaluation then encoTnpasses -all activities carried out to '-^^^ 
ii).fluence the evaluation— which in Some cases might mean preventing 
the evalu^iiioji frotn taking place. These activities 'are obstacles 
to conducting the^valuation and tendito distort the evaluatioft and 
Its finding, fn their-mbst negative forms they result , in a biased 
evaluation v/ith useless^findings. Political goals, however^ may ' 
have been met.^ ' -A, 

■ • • 0- ... • ' la - . ■ ... ■ . • 

* ■ " * ' •• . w , " ' \ , ' V . . ■ 

^ The politics of evaluation on the school SQene begins then 

^ ■ f ' ' ■ ^ o ■ ' / ' ' ' 

^with, the emergence of conflicting views aitd the takirtg of sides to 

. ■ ■ , * ' 

>onfluence the final outcomes, of the evaluation. 'What gives rise to 

different views and what brings-, them in conflict? ' 

Do you believe that the. goals of your school are already 
established or that the right to set such goals; is already assigned 
to specific group? ^r, do you believe that School goals must 
'constantly be negotiated among different power groups since goils 
appropriate to one group/may pot beneficial t6 others?- Should 
tlie schools focus on the development of skills', intellejct, or morality; 
or car^they accommodate alt three values?:* The anthropologi-st ^ 
Anthony Wallace tells us that conservatiy& societies* need skills to ; 
maintain thfe existing.-ibrder and therefore give skil\l developinerit a 
^top piriority. Ed Gordon of Columbia University observes that while 



our schools are operated by a society which maintains the status quo, 
what^poor people a«nd minorities need is riot mairitjeifance of the 
status quo but radical change. /Sdch change neceissitates the 
development of arf- awareness^f or htjmafi' rights and humanistic concerns, 
a morality, woich is perceived as being developed b^ the intellectuail 
function. ; "Thus," Gordon says, "the overall purpos^/of the. school 
j"s not consistent with the basic needs of 'disacivanta^ed people." 

• - > : f 

If thevgoals-'of a school are already set and focus on the 
.development of skills then- evaluation takes the form of comparing^ 
goals and outcomes-, the .development of standards, and^a dependency/ ^ 
on the use of written tests./ Where no such agreement exists, then 
the 'goals may have to be eva4^^^^ted and investigated, usually carried' 
out through a "needs assessment," The conflict between values 
inherent in existing-goaTs and th? values .that determine' new goals . 
is compounded by the Jieed to c'hobse evaluatioifi strategies for either 
set of goals. If thi*s political ijrpce^sM's not properly understood 
; and appropriatefly dealt wi<l)h^ It (jian distort a-n eval fetation that 
vinitiaiiy, begins with biased goalSr. ^ ' . , . > 



Another major source of corJiflidt in the area of evaluation 



centers on thev purely economic question of resources and the benefits 
to be^ expected from them. ; Simply v/ord'ed, ,thfe question asks, "Ar^ ' 
the mea'sured benefits of the program worth the costs, relative to 
possible alternative prp^rams| (including jsxisting practices).?" 



The opportunity for anyone-to pi a)t. the political game^ is nov/^fully ' 
realized. Questions!>6f prfori ties, efficiency, and effectiveness 



arise that are not Easily solved by politics or present t6chnoloig]es.\ 

The questions raise problems that are ■incredibly complex in areas 

•■• : . ■■ ^ ' ' ^ ■■■ ■ .. 

where|v/e have insuffi-cient. knowledge; ^'^Yet someone will make .a 

detenni nation of priorities if by no other simple 4neans than by 

approving a budget. As the researcher Xarol Weiss states,. "We 

are still in the business of poTicy-hatching on a trial -and-error 

basis in the absence of research knowledge." And,somepne v/tll also 

judge%uccess or failure, but what measures v/itl tfhey use? And, 

who wila decide an?l who wil l I judge? ^ , . 



Conflict- also arises by the way evaluation and accountability 
- . ■ V , - ..- ^ (■ \ ■ . 

are perceived by competing fattlons. Although accountability - 
■ - I ; ■ : ^ . * . 

overlaps evalluation, and is a| form of educational evaluation, 

evaluation and accountabilify are not peisceived to be the same. 

'*■ .' **.'.--.*■ , * ■ ■ . . 

Both concepts are concerned with the effects of school^ experiences * 

-■ ^ ■ >f . .. ■. " . • ■ ■ 

on studefits--*are the schools 4iving up to their claims.?' EvalQation, 
hov/ever, has tended to be associated primarily with educational 

- - ■ ■■v^" . ■ ' ■ - ■ . ■ 

effeGtiveness--'are' y/e succeeding in what we set out to do?' ^This 

is usually. an internal process.conducted within the school system 

» -> • 

by staff for internal docision-mak"^ng. Host decision si-tuations in 

■ - ^ ^ . ■ • ■ ■ ' . . ' ■ - 

the school scene. are tHeref ore decided and judged internally; On 
the othei" hand j calls for accountability tend to come from outiside 
\the sehpdl system and include an. external judgment. Al though . , 



accountability, also encompasses effectiveness, Its. main concern 
appe'ars to be vnth. efficiency;-- 'what are we'getting for our money 
and how well are v/e -getting it?'. Accouritability asks for evidence 
that supports the schools* claims^. of what they have. done. It 
demands public exposure of the schools* infeernany-made decisions 
and opens a closed system' to public scrutiny. It iS/ acknowledging, ' 
"the public's right to know what actions have been taken in the 
schools it supports an^^'hpw effective these, actions 'have »been."t 
^Accountability is a process disliked by school people v/ho see it 
eis vindictive and a form of outside interference in their prof ^S;$i0nal 
affairs, ' t ' ^ . ^ 

; I taught science and. English at a. junior high school in New 
York City where subsequent to my teaching assignment I s.arved as ^ 
the^school librarian. That v/as only some 12 years ago and little , 
seems to have' changed in the expressed concerns of that experience. 
An students in the school v/ere grouped in classes\,according to ; . 
abilities, arid subject classes were-assigned to .teachers Jay seniority— 
that is— the more experienced teachers taught the brighfer' stu;ients. 
Information for deciding in .v/hat class to place students came from 

0 ■ . • ■ ■=> 

''Standardized mathematics and English written^ tests; The special 
'enrichment classes had an^additioiftal^ I.Q. requirement. Decision- 
making was qui^a simple process and so v/as the process of 
evaluation. I was considered a successful and able teacher 
but was never , informed that I had been evaluated. If it 



occurred, I never knew about it. Whep I took over the schopV library 
I rose in prestige and status among my colleagues, again, not because 

. of an evaluation, but because I did not have ^ny teaching' assignments. 
From the view. of my cdl leagues, the library assignment was a pl'um job. 

^ While in;my teaching. assignment, IfkeotheK teachers,! graded ^ 
studerits and constructed tests. Jhe quality of test construction 

.^and of grading suffered frQin a laclc of> knowledge about test construction 
and. the absence of any policyN^n grading. At certain ability levels 
the brighter students -v/$re administered tests designed by the central 

, Board^^ but thein, effect upon grades v/as a teacher 's prerogative. - The 
major contponent of a student's final grade I remember was the ^'i nag! e 
Tactor—a judicious adjustment of the vs^^^ grade .that took into; ^ 

account the weaknesses of his human 'charajcter and the^^/eaknesses of 
my technology. The pracflae in total Was grading- and some glorified 
the practice^ by calling it measurement.; {Few teachers-, howevqr, eve^r 
made the error of identifying measurement with evaluation. That 
was an error to be committed by the admiriistrati on. For the most 
part; teachers did not make this mistake since they considered 
evaluation as something -^/hich v/as'. done tq please evaVuators. 

And what about evaluation in the school library. We]! , 
since, I did not assign .grades, my role v/a§ to help grade jteachers - 
papers at final examination time and to provide spac^ f^r teachers • 
grading thr^ir papers. Evaluation never touched the library, or — 



50 it appe^i^red. ^ , * [ 



In general, much lip service was paid , to evaluation. The 
concepts, however, weine feTdom' understood, and the procedures and 
techniques rarely used. What does an* evaluation tell you anyv/ay 
that you did not know before? ' There was a definite distrust of 
evaluation and doubts that it could accompTish anything. Why this 
feeling and has .it changed? ' ^ 

*We were al'l aware then df the ^imitations of our craft. The 

individual teachers were concerned Wtth the gap between their 

■■ ' . ■ ■ ■ *■ ■ ■ ' ' . 

expectatidnfs and their actual performance.. The profession seemed 
to demand too much .and we/performe^ too 1 jttle. This pressure upon 
teachers has not changed. We knew. then, arid still know very 1 ittle 
about -the nature of learning. When seen '"in their broader societal 
context v/e .find that wa simply do 'not have the knov/1 edge to treat 
serious problems directtj^ affecting the learning of large numbers 
of our population. However, what we do know is rarely appl ied. 
Measurement has its limits but progress has been made in its use 
for describing^^aiad assessing our problems." We know more than is 

. ■ .- ^ • . t ■ ' 

being practiced apd the reality, -as DeProspQ points out concerning 
evaluation,' is that^the art arid skill of evaluation as practiced 
remains undeveloped— I would add untried. If known evalljattqn 
techniques are pot practiced, then one should -expect the "political 
realities" of life to fill the void. ; 



. In the past several years, at least five national- commissions 
have examined the current scene in American secondary education. 
It's impressive to note what they agree on that directly concerns 
,us today. First, they observe that high schoofs lack clear goals,, 
^hich ts not difficult to understand. The schools' primary objective* 
is to educate students, .yet the schools ifiust politically interact 
with the community and demonstrate results ofj'nterest to the 
community/. Everything they do is therefore not in the interest of 
the students! education. T^e schools, however, are stilTseen as- 

pursjjiny ^.'^tn^exceedingiy narrow task even though they a/e surrounded 

■ ■• . ■ ' ■ ■ , » . . ' ■ ■' ' 

' ■ • ' 4* ... 

by multiple, social demands.*' The comrfiiss ions recommend that schools 
^define appropriate educational goals that go beyond the primari>ly 
cognitive and encompass a fuller range of human ; concerns." This 
recommendation declares that' the goals are .still not set.' Obviously, 
some confrontatiorl should b'e 'expected from those who feel the goals- 
are already set. Jhe conflict,\however, does present the opportunity 
; to employ avcii Table technology in evalualivje research to conduct an 
empirical investigatiion of' such goals. ^ Such* an -approach would entail 
carrying^QUt a "needs assessment" that provides everyone in the 
school system with information for initiating their own planning and . 
evaluation. It can also assist in defining policy for tt^ appropriate" 
use and interpretation of measurement instruments used* by departments 
in their evaluation efforts. And most importantly, a needs assessment 
can identify the required competencies lackinri within the staff to 
conduct such evaluation tasks and point to needed training. 



10' 



. ., >; New goals iiji'ply The repot'ts. Of the -Commissions 

also reGommend the establishment and support of pilot programs to -try - 

■ . : • ^ . 

out some of thiese ilew ideas. They concede though that carrying, out ^ 

ese\suggestions- will demand^ the use of new methods of evaluation 
aind new measures that will gaug^^^other modes of growth beyojid the 

narrow cognitive measures now employed. Such new atrectiohs they 

■* ' ■ ■ ' ' • '■"■*•''. ' - 

concede are. beyond th'e grasp of any single. cpnstituenfcy and \iil,l . . 
require the' partix:ipati on of a yariety of constituencies around key 
educational questions. One cannot epcape the obvious truth that 
edufifttSonal' cffange is i^nevi tajbly ;a process. /» 

The demand! for mqre evaluation of educational programs Is % 
increasifjg. And, althdtjgh evanuatipn can be of tremendous assistance 
in bringing about feducationajf chahg^.' it is still threatening lo ■ 'i 
school administratars and>^e^c,hers. mis may'be due in part/td= a ■. i 



-s ignifi cant 'number1pf ,,eivaluaiti^)ns -producing' negative findi'ngs«.,%t 
teachers arid admfnistratorslar^i not defenseless / and when threatened 
can^also play the pol ttical^^gahiie of evaluation. The defense 
n)echan,isms employed by therft^ are -many. / . 

Negative findings can be^^^'^ av/ay">very easily through 

rational izatioris . If . those fbr^whom the* prggram v/as ' desi^ned^do not 
benefit, others did, and ■ wit^^^^^^^ the program they could no^fhave .\ 
benefitted. Something gopdV; so ^qes the af^gument, di^ emerge from 
thd'^'pSg^ if thtfse-^^^ needed the program di'd not 

participate, then the prograniVs effectiveness cannot be assessed.* 



. It .is best, ifotvever, to 4tead 'tKe^'f valuation off at-the p 

befifrer. it prp^^^^ prevent Tt.^ft'oni takiiig ' .{ 

^ ■'. . " ' . >^ 

place at ali i jou can* .insist that what you are, doing has long." ' '9. 

range- effects arid i ts- eff ecti veness^eannot >preseht1y be '^lea5^Jfecl^ * . ' ' • 

Or,* you can argue . that the .complexity of v/hat you are doing jus^ .sV * 

cannot be measured, ^' If you do' make the mistake of al luding' to ;Sonie; • 

small but Si.gnift'cant resuUs that you have observed, "ins ist^^that ' 

available instnuments cannot: ineasure then¥ ' r-. ' 

' If faced with tlie pros:f)ect. of h'aVing to accept the conduct - 

of the evaluation, the pplitlcs of evaluation- will still provitle 

' • • ■ . ■ • " ■....».■■ , - ' • ■ . ■ ■ ■ 

^you iyith some -further defenses. ; Thev aim now is to employ some 

^ ■ ' *. * * . ' - " ' ■■ 

time*tested techniques "'to distort the final ^evaluation, rendering. - 
':rt ..useless. Forvexarpple, .pretend; you. bel ieve in the merits of an • 
objective evaluation^^^^th^ereby promo favorable^^nage of 

yourself. You ;aVe- never going to_do it, but it's the best/'posWre" , 
to take for. distorting. the evalua^ Or:, take a-look,at your 
present program and '?ee \^here you are successful.. Now select those 
aspects that appear successful and conduct. the evaluation on'theb.. .If 
that J'eye-wash- doesn't work > then try a good %/hite-wash.'' Where you 
note failure/ in fhe progk^am, securre "testimonials" from people who 
like yoi) and" s'upport yourj, efforts before someon^ fi^om the other, camp 
proposes an objective appraisal. Hov/ever, if the failures are- . 
major then try the technique of "substi tuti on "'^^by /shifting the 
focus to some minor part that has succeeded... And finally, delay 



or prolong the evaluation as 'much as possible since I'n time everyone 
vnll forget what it was they v/ere all concerned about, Al.so, 
"postponement'' vn 11 remove thai; quality of timeliness that makes 
,thG- information sc^useful-. v Do you recqgnl^^^ 

.1 * Most of u^ of course, are familial; with the golden rule of 
the pol;itics of evaluation*-"DQ unto others', as they would do unto* 

you."' Now, every once in a while, a program comes into existence 

■V -J.. . ' : ' ' ■ ' , . ' - " . 
that attracts tob^iich atterrtion tp itself. . From pov/er interests 

within the administration or the school system emerge co^itions. 

Every now and then one of the^e coalitions will submerge and employ y. 

tactics .of a "submarine." Their ultimate aim is to to.rpedo on 

destroy the program regardless Of its worth. Thjeir chief weapon is 

evaluation^-the politics of evaluation, ' ♦ , 

What has ev^iluati^on'done to deserve such a bad press? 
Because decent people, following their own setfish intere^j^^ ; 
the concepts of evaluation and Bistort^^T . • 

When Scientists alssume that they can apply logic to the ways . 
of nature they assume that nature is reasonable. A properly conducted 
evaluation assumes tha't rigoroas methods of "logic wifl be appl ied 

in Its investigations. What is implied by these assumptions v/hen 

' . • t *' ■ ■' ' ' " ' " ■"" "'• 

they are applied to the refusal. of administrators and ^e^^^ to 

'. ■ • ■ ' • ■ ■ ■ ' { 

quantify obje<itijves , that .is, when they say that a particQlar - ] 



objective cannot" be measured? It may imply a serious distrust of 
neason'and the belief that logic cannot be applied to the*! own .area 
of actiV:ity. This unreasonableness may have been a major impetus 



^for the rise of the accountability movement. 



'I was able to closely observe the -politics of accountability 

when following my school experience I served! as director of a . 

community guidance' agency in Manhattan. The agency v/as privately 

financed and' founded by Jeaders of the'^Puerto Ri can Community in I 

New Jork City to provide guidance services needed by Puerto Rican. V 

students who. were niot receiving these services in the schoals. We ^ 

, • • . • ^ . , . . ' • ■ \ . 

tal'ked a lot)then about accountability, and also acted *on. what we 

thought were some reasonable^assumptions; Interestingly enough, 

the model foKaccountability designejJ several years later at ^ucational 

Testing Service for New York City, was based dn similar assumptions.. 

Th§ Wsic assumption of; this^ is that where, educational deficiencies 

occur, methods earn be found tq eliminate or decrease them. Considering^ 

the billions of dollars spent ^ach year oh education,^ is this a ' 

rea>sonable expectation to assume? But let us not ^get diverted by 

the money issue, for that is onJy one aspeqt of accountability, and ^ 

too much emphasis has been placed upon it* Our community -s perception 

:of accountability then concerned equality of educational • opportunity 

and participation in the formulation of policy. - 

, ■ ■ ' ■ :V ; ■ y ■ 

Our concern with* equality of educational opportunity was 
^obvious. Our children were failing 'to learn ar^d the school s vvere not 



responding. Drop-out and unemployment rates told us two' things: 

(1) the problem will get worse v/ith time-, and (2Kboth the individual 

. Puerto Ri can and the community would get hurt—the individual* " 
Puerto Ric-an' because he would not be able to achieve the- standards 

^ expected' by theOarger society, and, the community because itAvould ^ 
not be able to produce the'doctors, lawyers, tea*chers, arid other 
service workers it needed, including its political leaders, -The 
frustration for the community was simple. It could ftot identify 
the authorities., be they individual or agencies, v/ho v/ere to be 

held responsible and accountable for the conditions in the schools/ ' 

fl.. . ' , , ■ , ■" ■ , ^ 

Tbe answer therefore- v/as obvious: Participation in the affairs^of 

the school system for the purpose of controlling school po\icy--the / 

direct application of the ^politics of accountabiVity. 

** -»■ f- 

■ ■■' f * ' : ^ ■ ■ 

\ ^ » Our target was the central Board of Edux:ation. Using the 

. » - > A 

; facilities of the agency a. verbal and capable group of professionals 

who were politically astute was organized^to negotiate with, the 

Central Board. One evenijng a month members of the Central Board met 

with us in my office to discuss policy. and programs directly affecting 

the Puerto Rican student. We learned a lot, bul; -it took us time. 

The Central Board consisted of some very decent but unres^^ponsive 

human beings; They espoused some very liberal views^and shov/ed some 

- ■- . ■ . - * ' . ■ 

compassion for our cause. But v/e could not achieve any results through 
them. I myself devised a personal theory to explain the impass. 
These people were truly not the power. They were only a buffer zone 



for the real, power hjding behjnd them. But it seemed to me that to 

• ■ * • ■ • * ^ - \ * . " ^ 

be a part of that buffer afone the rmvard had to be very great or you 

• ■ ' \ ■ ■ * * ^ 

had to be a masochist. 

. • ■ * " ■ ■ • . 

. "The next Step of course is history. We, were not the only 

grcyjp. negotiating v/ith the Central Board. Coa-Jitions were formed 

I*- , ■ • 

and strategy was changed to control, the local- districts--the strategy 

of decentralization and tffe emergence^of ^the noisy forces. Tcame 

to v/ork for the* College Entrance Examijriation Board 8 years ago and 

the confrontation continues. V > 

-. * • • I . ■ • , . .■ • 

And as a matter of fact»'so it continues everywhere else. A 
study titled Governing American Schools v/as published lasiS year on 
a research project that began in'1968 that looked at the political 
nature of the local school district. Of concern to us- is the strong 
correjlation between the level of political activity* in a school 
district and the responsiveness of school board members to their 
constituents. The study reveals that American school boards are, 
generally unresponsive to the wishes of their constituents , but 
in most districts the-superirttendent is so dominant that the • 

unresponsiveness of the board is of little practical consequence. <> 

■ > ". ■ . . V '\ . 

In fact, in political districts where scfiobl boards v/ere v/illtng,' 

■■ ■ * . ■ . ■ * _ 

to oppose their superin.tehdent is where 'thie study finds they were' 
least l.ikely to s^'ucc^^d in overruling }iim. How-does one then make 

.local schools mor^ responsive to the people they serve? Maybe^ tha't 

• ' • '■ ■' ■ ■ . ' •■ ' \ , ' / ' 
1 s i^he. true Issue ih|acc6untabil ity. . - 



The technical assistance needed by commuhity grotips to evaluate 
■/school programs 4s increasingly being providexi by external evalua tors. ^ 
T|ie external evaluators' major interest is ^in describing what took 
piafce in a giVen education setting and judging v/hat resulted from it. 
Their role is one of appraising educational procedures "and results. 
This is slightly dfffeVent from the major interests of administrators 
and teachers who use evaluation for the purpose of obtaining data on/ 
which to basfe decisions'^affeGting students, and to detenpine'the' 

effectji veness of "their programs: These are important jdifferehceX , 

■ . ' ■ I - " ■ • ■ • ' • / / 

that can be recoQciled, The. ideJkl I 'Would think is/for the external 
evaluators to base their. f landings on'the data used by .adijiini/Strators 
and teachers in their decisionnmaking. But this assumes ^ exTstence' 
•of an internal evaluation data collection s;^stemfwj thin /the* school 
system that is objective and dependable— whiw is rare/y t.ljp^c^^ 
"Teacher grades of students V perfo#nance are extr«me/y unfeTiab|e"-- %■ 
teachprs do not correlate wii^h each otiner in grades assigned to* the 

• * • . " ... . • / * . 

saffie student." Outside evaluators, to meet accowntabillty requirements 
in an objecttve manner, are therefore turning increasingly. to the ^ 

use of standardized achievement tests that depend upon national norm^ 

* • ' ■ / . ■ .. 

for the interpretation of results. ; The most/widely usey tests measure 
achievement in subjecfareas such as/ mathematios and Englisli skillsVf 
From rrfy viev/ at the College Board j; fear, /as others do, ;that .a- ^ 
dependency upon standardiz'ed tests might/suppress areas in the curriculum 
.that encompass liumanistic concerns^ Furthermore, the lack'bf^understanding 



0% >aterpretation techniques by users of the^e scores produces, sojne 
Startling abust<S, such as the unparddnable raisplacement of BTacK and 
Spanish-speaking^chitdren in classes for mentally retar'deji Ghiidren* 
Standardized"^ests^used in elementary schools have been found* to, be . 
by and lar^ unsatisfactory ; Strong criti,cisms are being made of • 
their misuse for meeting demands of accountability/ *^A;void is seen 
' to exist laetween tqe demands of accountabili'ty and the present stock 

• .■ i\ - : ■ ■ ; ■ ■ ■ 

of standardized instruments." Although a test may cover a few 
program objectivesi, the tests'^^re not designed V'/ith specific programs 
in mind-, vvith a poiDr overlap occurring between the objectives the 
test measures ar)d the actual objectives of the program. . 

Sometimjss Ihe actfSuhtability goes beyond totally "farming out" 

the evaluation- it* Gaji take the form of performance contracting - 

^ ' ; ; / "i: • ■ ■ ' . : ■. ; ^' . ■ _ .- . 

where even the instructional attivities are turned over to an 

external private, firm along with the demonstration of measurable 

results on a standardized test. Proposed woucher systems arfd 

alternative educational-systems are another form of accountability * 

where parents- are gtven tuition vouchers and, allowed to choose and 

pay for their children 's ectucati on- at a school Of their 6v/n choosjng. 

These forms of acc&uhtability display a latk of trust in the ability 
■■■■ . ■ - ■ ■ " ' ■ ■ 

of the school system to produce ^acceptable results and its willingnes 

, t p res'pond to the needs of the community. ^ ' L 



It may be 4:hat tfae concept of the ^extern^^ evaluator may not 
be v/orkable. Evaluation is integral to planning anci*it makes little -, . 
sense, to separate the Jfwo.- tU makes r\o sense 'to develop evaluation . ^ 
techniquesrthat,:for;;V/^hatever po^ reason/ are n'6t applied." ^- 

^valuations b/^external evaluat-i on- experts atre being \gnored, if 
us^d at all i For , evaluation to haVe-a.ny impact, it must be practiced. 
And for it to be prai^ticed, it jnust become part of the normal day-to- 

■- r ' J ' ' ^ ; ,-\ ■■- ■ ■ ^ ■ " \' ' 

^day activities- and .procedures of the pnactitioner-Tthe on-1 infe , 
administrator and teacher; A pTossible solution to the dilemma 
might be to uSe\ external evaluators to audit the restilts of ' 
Internally developed and operated evaluation systerrts arid thisir results. 
The auditor of evaluatlor\s ensures that evaluationjs are properly - 
carried out. ''In genenarl , the acidi tor Ipoks over the evaluation plans, 

-suggests changes if -necessary, and ^ after amendments have been made, 
approves the plans, tie monitarS the data collection. Later, he checks 
some of the analyses to ensure that they ^haye b.ee'n properly performed. ; 
rtnally. he reads an ea')*ly, draft of the evaluation reporlt,! suggests 
changes, and approves the finaV version." . . ' 

/| Are there any implications for the school media ceViter, that • 

IS the library, in the accountability movement? The politics^of 

■ . - • ' • ■ ■ ■ ■ V • .■ \ . ■ . 

accountability focuses on resources and poMcy-making. The existence 

. ^ ■ 4. ^ • , % . , . . . ■ • 

of the school media^^fnter and the rationale" for -its existence are 

outcomes of policy formulated and arrived'at by a political process. 

Every time resources within a school sys^m ^ire allocated,- the final budget 



reflects a re-examination of ^^'that policy. * In many cases *po1icj(^ ' 
reVievv; interprets the media center as -a support element to the more 
basic departments of instruction Jhe wedia center is perceived as* 
not having a primary mission of its own, although much lip ser^vifce . v 
is paid to the "hubs'^ior center of the school. Right now many * 
New .York City schools have had Ithe ^^spokes" removed from their "hubs.*' 
As a support service without a mission of its own, the school, library 

is fjlirst accountable to the internal decision-making' structure' of 

• .• ■ ' ■ : ' i ' . ' ' i 

the school— that is— the teafchers iind adrniTiistrators^^^^ supports! 

, JAs a cost unit the school library ^becomes an item of accounfabiTi 
vto community policy maimers. Do' they evaluate the library's contribution 

to the school's overall .effectiveness, and if^ they do, what data do -» ' 

• • • ■ . ■ ■ ■■• ■ * '■ ^ ■ V • . u--',., 

they base it on?--f Or,* do they perGeive the library ds something nice / 
that 6very schbol should have and leave it at that, there are limits , 
to thG| ability ofVa -tdmrounity^ to support its^^^^^ instructional 
.salaries are steadily^^^^^ the avail aJDle resources -ta t^ose limits. 

Salaries are in direct competition wi for materials and the 

materials budget ^includes' clafisrobm. supplies as well as the media 

■ ■ . • - . ■ ° . ' '^^^ ■ ■ ■ / ■ ■ 

center's books, films,»and\6q.uipment. HSo whether you see it or not, 
andoWhether it 's being 'done in a manner that is fair, an evaluation 

, : •. ■ ..-^ . ^ ' - • ; J • - ■ .'"^^ 

of: the school library is carried cait every time a budget is aTlocated. 
And the pf:ocess -of allocating keeps getting tougher. Harder questions 
are being asked,vbut v/ill the information be forthcoming?.' . ' 



• * Today'5 workshop was a mast imijiortant step forward. in designing . 

evaluation, sys.tems for the --schootiTiedia, center that^also provides 

information for purposes of accountability. Goals were identified 
.. - • ' ■ * 

• ■ * '• • ' " • " 

for the school media* center that establish it as a primary instructional 

unit w^itljea misst^ of its own. Such goals go/ beyond the support 

of the goals of other instructional units. . As these gbals, become 

translated into an internalized evaluation systeni for appropriate . ' 

decision-making by the riiedia^ center specia-fi'st the information 

required for account-ability will be forthcoming* The^m^dia center 

wi^l be able to provid? the type of information that is increasingly 

being demanded by policy makers, inforrfiation that* these policy makers 

^can.use to fa^irly evaluate the library and appropriately -allocate 

the required resources. The alTacation of resources to the media 

f ' ' ^ ■' • ' - V ■ ■ 
center will then be based on need demonstrated *by objective evidence - 

and not on an unreliable "friendV of the hub'' assessments^ 

. The approach presented in^ today's \vork^,hop. is ona that wal 
used to successfully ^implement evaluatior)^ systems to mani tor the 
learn^ing^^f unction of publ-ic libraries in nine cities. This ap'pr^wtgh 
places its majbr^ Emphasis on- the direct participation* of librarians • 

-providing the service "in the design of the system. It ajlov/ed . ■ ' 

■ ^ ■ ■ . ■ . . ' ■ . " ■ -3 ' ■ ■ . ; ■ 

librarians to perceive the value of scientific evaluation and reduced 
the distorting influences of political coiisiderationstf The final 
design is one that ts used, one that provides, the information heeded 
for decision-making, but most important, one, that directly serves the . 



' • V ,■■.:■■;•■*.■■■.■■■■' •21' 

.immediate cdncerns of the on-^Hne librarian and of the administrators. • 
The' extra "added pl US is that it also serves the community's ""coi^cerns . * 
fpr accountability in a painless and highly satisfactory jjianner. j 

The approach takes time to implemdtit and is not-developed ^- 

, *^ overnight. Librarians mffst first become^knowTedgeable in^ the . / ; ; 

: techniques Of evaluation- But 'that is not enough. It is as equally ' '^^ . 

important to learn hov/ to apply these techniques in politically 

.sensitive environments--in some xases , explosive environments v/heVe 
■ ■ - ^ ^ : ■ ' V ^ ■,, ■ ^ : . ' . . 

expectations are high, performances low, and despair rampant. The 

technology of planned change encompasses important politi.cal realities 

; ■ for, successfully employing the technology- of planning and evaluation ■ 

: for bridging this gap.. 0n6 technology can assist in introducing change, / 

the^other in managing it. Together these two technologies pravide the 

school media center >/ith the needed |:.nov/-how for launching programs «of 

^ change to meet the, accountability coVicerns of students ;and of the 

eommunity. What need; is there to d^Jlgn and^ finance new alternative 

scliools when the potential for such s|rvice exists within the present 

resources of school media 'centersl Voucher systems allow parents to 

select alternative educational systems of their own chbosing for their 

children. A similar voucher system internal tO; a school system might 

be used to allow students .to select al ternative'^ rtiodes of learning 

through independent study by way of the school media center. The media 

center serving as an al ternative. school for independent study can bridge 

the gap in service to unserved populations within th^> school . If 
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^schools continue to Insist on organizing themselves to edoreate the 
inythicaii-^or fictitious average student, then school me^ia centers • 
might assume as one of their learning missions. 'the educa^itfn* oT^^the. 
bright, the bored, the drop-out,' the non-joiner j and the individualist 
who do not average" out . Edrly v/arning systems can be devised to 
identify these students before they become a problem, to themselves^ • 
the school and the community. School ;me.di a centers serving them 
v/otild thfen'*' have missions of their oiwri centered around learning mode^" 

'and styles, of t^ndepjendent study and specifically identifiable . 

■V;- • • '.A : : ■ ■ \ ' ' ^ -■■ • ' • " ^ 

cj>nstituenc*ies. For purposes of accountability , they v/ouldn'n 

most instances be doing something someone else is -not and forisdmeone 

: ':- , -V* v ' ■ • - " " V. - ... y ' , 

^at is !?eing poorly served. As v/e all know, constituencies are 

very impoH^'^ant.in the politics of accountability. 

' ■ ■ . . . * * ' ■ " 

. Such a mission for the school media center is not foreign to 

the thinking of many librarians and there are many who support the 

concept. It is also not necessarily the only one. It is, however, 

an alternative v/hen examining goals, objectives , effectiveness,- 

efficiency and priorities. - Today's exercises v/ere meant tcf demonstrate 

the availability of a technology for dealing with slig>j alternative " 

missions and to provide a possible^'ansv/er to dealing with the difficult 

• -v- ■ • . ^ ' • : ■ ' 

problems rais&ed by <accountab]l ity . I hope that some of your needs as 

- p * ■ . ■ ■ i ■ ' ' • - . '■ , . 

media center specialists have therefore been met. 




